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Abstract — The  generalized  likelihood  ratio  test  (GLRT)  is 
invariant  with  respect  to  transformations  for  which  the  hypothesis 
testing  problem  itself  is  invariant.  This  result  from  the  statistics 
literature  is  presented  in  the  context  of  some  simple  signal 
models.  This  is  an  important  property  of  the  GLRT  in  light  of  its 
widespread  use  and  the  recent  Interest  in  invariant  tests  applied 
to  signal  processing  applications.  The  GLRT  is  derived  for  some 
examples  in  which  the  uniformly  most  powerful  invariant  (UMPI) 
test  does  and  does  not  exist,  including  one  in  which  the  UMPI  test 
exists  and  is  not  given  by  the  GLRT. 

Index  Terms — Signal  detection,  signal  processing. 


I.  Introduction 

The  likelihood  ratio  test  of  the  statistics  literature  is 
invariant  to  sets  of  transformations  for  which  the  hypoth¬ 
esis  test  itself  is  invariant  (e.g.,  [l]-[3]).  The  likelihood  ratio 
test  statistic  is  obtained  by  replacing  the  unknown  parameters 
under  each  hypothesis  with  their  maximum-likelihood  estima¬ 
tors  (MLEs).  In  the  engineering  literature  (e.g.,  [4]  and  [5])  the 
likelihood  ratio  test  is  known  as  the  generalized  likelihood  ratio 
test  (GLRT). 

That  the  GLRT  is  invariant  is  an  important  property  in  light 
of  its  widespread  use  and  the  increasing  use  of  invariance  prin¬ 
ciples  to  obtain  tests  for  signal  processing  applications  [6].  Eor 
example,  for  the  class  of  matched  subspace  detectors,  Scharf 
and  Eriedlander  [4]  note  the  invariance  of  the  GLRT  and  show 
that  it  is  uniformly  most  powerful  invariant  (UMPI).  Eor  cases 
in  which  the  UMPI  test  does  not  exist,  an  UMPI-inspired  per¬ 
formance  bound  can  be  used  to  evaluate  the  suboptimal  perfor¬ 
mance  of  the  GLRT  (and  other  invariant  tests). 

The  following  references  provide  additional  examples  of 
invariant  tests  in  the  engineering  literature.  The  adaptive  sub¬ 
space  detectors  of  Kraut  and  Scharf  [7],  [8]  extend  the  matched 
subspace  detection  problem  to  the  case  of  unknown  covariance 
using  GLRTs.  Kelly  [9]  provides  a  GLRT,  for  an  invariant 
adaptive  detection  problem,  that  is  invariant  and  UMPI.  Kay 
and  Gabriel  [10]  provide  an  invariant  GLRT  for  a  problem  in 
which  the  UMPI  test  does  not  exist  and  compare  it  with  the 
UMPI  bound.  Nicolls  and  de  Jager  [11]  provide  an  example 
for  which  the  GLRT  is  invariant,  but  is  not  the  UMPI  test  that 
exists.  Bose  and  Steinhardt  [12]  address  an  invariant  problem, 
for  which  the  GLRT  may  be  intractable,  and  use  maximal 
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invariants  to  facilitate  the  search  for  reasonable  tests  among 
the  class  of  invariant  tests.  Kraut  and  Krolik  [13]  generalize 
the  invariance  group  of  Bose  and  Steinhardt  to  obtain  a  scalar 
GLRT  that  is  a  maximal  invariant  for  the  problem,  and  Kraut 
et  al.  [14]  further  show  that  it  has  momotone  likelihood  ratio 
and  hence  is  UMPI. 


II.  GLRT  Invariance 


The  problem  is  described  in  terms  of  a  hypothesis  test,  with 
the  null  hypothesis  denoted  by  Hq  with  parameter  belonging  to 
the  parameter  space  fig,  and  the  alternate  hypothesis  denoted  by 
with  parameter  belonging  to  Qi.  As  stated  in  Lehmann  [1] 
(and  elsewhere),  the  problem  of  testing  Tfg  :  d  G  flo  against 
1  :  G  fli  remains  invariant  with  respect  to  a  group  of  trans¬ 
formations  if  the  distribution  remains  in  the  same  family  and  the 
parameter  spaces  are  preserved. 

We  first  obtain  a  density  relationship  that  can  be  used  as  a 
necessary  and  sufficient  condition  to  show  that  the  distributions 
are  preserved  over  a  set  of  transformations  g  G  G.  Initially  using 
the  notation  of  Lehmann  [1],  let  a;  be  distributed  according  to  a 
probability  distribution  denoted  hy  Pg,  6  G  fl,  and  let  G  G 
be  a  transformation  acting  over  the  sample  space  X.  The  dis¬ 
tribution  of  gx  belongs  to  the  same  family  of  distributions  with 
perhaps  a  different  value  of  the  parameter,  denoted  g6,  which  is 
an  element  of  the  original  parameter  space  Q  (i.e.,  g6  and  6  be¬ 
long  to  the  same  hypothesis).  Lehmann  denotes  the  distribution 
relationship  as  Pe{gx  G  A}  =  Pg9{x  G  A}  for  all  Borel  sets 
A.  To  gain  some  insight  into  the  meaning  of  this  relationship,  we 
define  an  interval  A  =  (a,  b),  and  for  illustration  assume  that  g 
acts  monotonically  (although  the  result  holds  more  generally). 
Expanding  the  left-hand  side  gives 


Pe{gx  G  A}  =Pg{gx  <b}  -  Pgigx  <  a} 

=  Pg{x  <  g~^b}  -  Pg{x  <  g~^a} 

g-'^b 

=  j  pUC;0)dC. 

g-'^a 


Letting  g  =  g(^  and  changing  variables,  this  integral  can  be 
written  as  Px{g~^'>T,  0)\{dg~^g) /dg\dg.  A  similar  expansion 
of  Pgg{  X  G  A\  gives  j^px{rj',gO)dg.  Therefore,  we  have  that 
Px{g~^ri\0)\dg~^gl dg\  =  Px{g\g6).  Ch&ngmg  dummy 
variable  and  moving  the  Jacobian  to  the  other  side  of  the  equality 
for  notation  purposes,  we  write 


Px(x-,6)  =Px{gx-,g6) 


dgx 

dx 


(1) 


It  is  now  shown  that  given  a  problem  that  is  invariant  with  re¬ 
spect  to  a  set  of  transformations,  say  all  g  G  G,  then  the  GLRT 
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for  that  problem  is  also  invariant.  The  GLRT  is  obtained  by  re¬ 
placing  the  unknown  parameters  under  each  hypothesis  by  their 
MLEs  under  that  hypothesis.  This  can  be  written  as 

X  _  maxegOi  p{x-,  6) 
maxeeoo  p(x;  6) ' 

To  see  that  the  GLRT  is  invariant  with  respect  to  transformations 
gx,  for  g  G  G,  consider 

maxego^  p{gx;  6) 

maxeeoo  0) ' 

Replacing  the  parameter  notation  6  by  gO  (with  g  an  invertible 
transformation)  and  inserting  a  factor  to  the  numerator  and  de¬ 
nominator  that  will  be  used  later  gives 


L{gx)  = 


L{gx)  = 


maXg^GQi  p{gx\ gO) 

dqx 

dx 

maXgeeQo  gO) 

dqx 

dx 

Note  that  \dgx/dx\  can  be  inserted  here,  since  it  is  assumed  not 
to  depend  on  6.  Using  the  invariance  relationship  of  (2)  gives 
the  ratio 


L{gx)  = 


maxgeeoi  6')  _  p(a;;  0) 


maXgggQo  p(a;;  61)  maxg^g-iQ^^  p(a;;  6) ' 

And  since  the  parameter  spaces  are  preserved,  g6  and  6  belong 
to  the  same  hypotheses 

maxegoo  p{x-,0) 

And  hence,  L(gx)  =  L(x)  for  all  g  G  G.  Given  that  the  hypoth¬ 
esis  testing  problem  is  invariant,  then  the  GLRT  is  invariant. 


III.  Examples 


Three  examples  are  provided.  All  three  are  invariant  hypoth¬ 
esis  testing  problems.  The  GLRTs  are  derived  and  are  found  to 
be  invariant  as  expected.  The  notation  used  for  these  examples  is 
first  summarized.  The  vector  x  and  its  elements  are  the  original 
N  data  samples.  The  vector  y  and  its  elements  are  the  result  of 
some  group  transformation  acting  on  the  original  samples.  The 
vector  m  is  used  for  maximal  invariants,  and  L  denotes  a  test 
statistic. 

Example  1:  Detection  of  a  DC  Level  of  Unknown  Amplitude 
in  Gaussian  Noise  of  Unknown  Variance  ( Special  Case  of  a 
Gaussian  Linear  Model  [5]):  GLRT  is  UMPI. 

This  detection  problem  formulated  as  a  hypothesis  test  can  be 
written  as 


Wo  :  x{n]  =w[n] 

Til  :  x[a\  =A  +  'w[n\ 


for  rr  =  0, 1, . . . ,  N—  1,  where  A  is  a  deterministic  unknown  pa¬ 
rameter  that  may  be  less  than  or  greater  than  zero,  and  the  w[n] 
are  white  Gaussian  noise  (WGN)  samples  of  unknown  variance 
(T^.  A  UMP  test  does  not  exist  for  this  problem,  since  the  hy¬ 
pothesis  test  is  two-sided.  This  example  is  a  special  case  of  a 
problem  studied  in  [6]  and  [15]. 

The  probability  density  functions  (pdfs)  under  the  hypotheses 
Wo  and  Wi  are  given  by 


1 

(27ru2)f 


exp 


-1 


N-l 


n=0 


and 


1 

(2Tra'^)^ 


exp 


-1 


N-l 


E 

n=0 


{x{n\  —  A)^ 


and  are  denoted  by  Px(x;  Wo)  and  Px(x;  Wi),  respectively. 

The  problem  is  invariant  under  the  group  of  scale  transforma¬ 
tions  defined  by  the  set  G  =  {g  :  g'x.  =  cx,  for  c  76  0}.  The 
pdf  of  this  transformed  set  of  samples  is  Gaussian,  and  the  pa¬ 
rameter  spaces  before  and  after  the  transformation  are  the  same. 
Eor  example,  the  mean  is  zero  under  Wo  and  nonzero  under  Wi 
for  any  element  of  the  set  G.  It  is  easy  to  see  in  this  case  that  the 
density  conditions  of  (1)  are  met. 

The  GLRT  is  obtained  by  substituting  the  MLEs  of  A  and 
0-2  under  each  hypothesis  into  these  pdfs  and  then  constructing 
the  likelihood  ratio.  The  MLEs  are  A  =  (1/W)  a;[n], 

^0'  =  (l/A')Et“o'^"M,anda2  =  {llN)Y.nZ^{x[n\-A)f 
where  hats  denote  estimators  and  subscripts  denote  the  hypoth¬ 
esis  to  which  it  belongs.  Substituting  these  into  the  pdf  equa¬ 
tions  px(x;Wo)  and  px(x;  Wi)  above,  constructing  the  likeli¬ 
hood  ratio,  and  simplifying,  gives  the  statistic  We  will 

use  a  monotonically  increasing  function  of  this  as  the  GLRT 


iGl(x) 


El~o^N 


where  the  threshold  7(jx  is  selected  to  satisfy  the  probability 
of  the  false-alarm  requirement.  The  GLRT  is  scale  invariant  as 
expected,  since  Lgi(cx)  =  i)Gi(x)  for  c  76  0 

One  approach  to  deriving  the  UMPI  test  is  by  constructing  a 
likelihood  ratio  using  the  pdfs  of  a  maximal  invariant  statistic. 
A  maximal  invariant  for  this  problem  is 


a;[0]  x[l]  x[N  —  2] 

x[N  -  1]  x[N  -  1]  ■  ■  ■  x[N  -  1] 


We  need  the  density  of  m  under  each  hypothesis.  To  obtain 
the  density  of  m,  we  first  transform  the  original  data  x  to 
mi  =  [(a;[0]/a;[iV  — 1])  (a;[l]/a;[W  — 1])  •••  {x[N  —  2]/x[N  — 
1])  x[N  —  1]]^,  which  is  of  the  same  dimension  as  the  original 
X  and  then  marginalize  over  a;[iV  —  1]  to  obtain  the  pdf  of  the 
maximal  invariant  m. 

Using  the  standard  formula  for  transformation  of  a  random 
variable,  we  first  obtain  the  pdf  for  mi,  (mi;  Wi),  which  is 


(2Tra‘^)  2 


exp 


^  iHn]m[N  -  1]  -  Af 


/'N-2 


2cr2 


\n=0 


-b  (m[N  —  1]  —  Ay  I  \m[N  —  1]| 


itV-l 


where  \m[N  —  1]|^  ^  is  the  Jacobian  factor.  The  exponential 
factor  can  be  expanded  as 


exp 


-1 

E2 


/'N-2 


m 


'[iV  —  1]  rn^[n]  +  ij 

/N-2  ^ 

—2Am[N  —  1]  I  ^  m[n]  -b  1 


xn=0 


+  NA 


Using  this,  marginalize  the  pdf  of  mi  over  m\N  —  1], 
and  making  the  obvious  extension  for  Wo,  the  ratio 
Pm(ni;  Wi)/pm(ni;Wo)  is  as  in  (2),  shown  at  the 
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bottom  of  the  page.  Applying  a  change  of  variables 
where  we  let  2;  = 


making  the  substitutions  and  cancelations  between  de¬ 
nominator  and  numerator,  the  ratio  becomes  as  in  (3), 
shown  at  the  bottom  of  page.  This  is  increasing  in 
l(I]n=o^™N  +  in  terms 

of  the  original  samples  is  \iY,n=o  ^['^])/iY.n=o 
This  is  the  the  GLRT,  and  hence  the  GLRT  is  UMPI. 

Example  2:  Detection  of  a  Known  Signal  of  Unknown  Lo¬ 
cation  in  Gaussian  Noise  of  Known  Variance:  GLRT  is  not 
UMPI,  and  UMPI  exists. 

The  detection  problem  formulated  as  a  hypothesis  test  can  be 
written  as 


7io  :  x[n]  =  w[n] 

Til  ■  x[n\  =  A8[n  —  A:]  -|-  w[vi\ 

where  S[n]  is  a  discrete  delta  function,  and  k  G  {0, 1, . . . ,  iV  — 
1}  is  unknown.  As  before,  n  =  0,1, . . . ,  N  —  1,  and  the  w[n] 
are  samples  of  WGN  except  in  this  example  the  signal  amplitude 
A  >  0  and  the  variance  are  known.  Under  Tii,  the  N  samples 
consist  of  A^— 1  noise  samples  and  one  signal  plus  noise  sample. 
This  example  is  a  special  case  of  the  problem  considered  by 
Nicolls  and  de  Jager  [11]  and  can  be  found  in  [16]. 

As  in  the  previous  examples,  we  first  establish  the  invariances 
of  the  problem.  Since  the  location  of  the  sample  containing  the 
signal  is  unknown,  we  should  expect  that  the  ordering  of  the 
samples  is  not  a  relevant  feature  of  the  problem.  The  problem  is 
invariant  under  the  rotation  group  G  =  {g  :  gx  =  P^x,  for  I  = 
0, 1, . . . ,  —  1},  where  is  the  right-shift  permutation  matrix 

that  shifts  the  samples  I  positions.  This  transformation  group  is 
called  a  cyclic  permutation  in  [1 1].  The  densities  of  the  original 
samples  Px(x;  Tio)  and  px(x;  Hi)  are 


1 

(27ru2)f 


exp 


-1 


N-l 


n=0 


and 


1 

(27ru2)f 


exp 


N-l 

n=0 


The  problem  is  easily  shown  to  be  invariant  using  (1). 

To  find  the  GLRT  for  this  problem,  we  need  the  MLE  of 
the  unknown  parameter  k  under  Hi-  The  equation  above  for 


Px(x;  Hi)  is  maximized  when  the  expression  of  the  exponent  is 
minimized  or 

/N-l  \ 

k=  argmin  I  {x^—A6\n  —  k\)  1  . 
fcG[0,tV-l]  J 

The  value  of  k  that  minimizes  this  expression  is  that 
which  maximizes  2Ax\k\.  Hence,  the  MLE  is  = 
argmax;i,g[Q^^_^  The  GLRT  is  obtained  by  con¬ 
structing  the  ratio  p(x;  k.  Hi) /p(x;  Ho),  which  is 


(27r(T2)  2 


exp 


-1 


2^  En=o^  ^  max(x) 


20-2 


(27r(T2)  2 


-w  exp 


-1  sr^N-1  2 

2cr2  Z^n=0  ^ 


\n\ 


where  max(x)  is  used  for  x\k\.  This  is  increasing  in  max(x). 
Thus,  the  GLRT  is  Lg2(x)  =  max(x)  >  7^2  where  the 
threshold  is  set  to  satisfy  the  Pfa  requirement.  This  is  invariant, 
since  Lg2(P^x)  =  Lg2(x)  as  expected. 

Eor  comparison  with  the  optimal  invariant  test,  we  outline  the 
derivation  of  the  UMPI  test.  A  maximal  invariant  for  G  is  given 
by  m  =  P^x,  where  I  is  selected  such  that  the  maximum  sample 
(the  probability  that  two  or  more  are  the  same  is  zero)  is  the  last 
element  of  the  vector,  i.e.,  in  the  N  —  1  position.  The  pdf  of  m 
is 


N-l 


Pm(ni;  Hi)  =  ^  Px(P  'm;  Hi) 


1=0 


(27rcr^)  2 
N-l 

•  ^exp 
1=0 


■-1  y 

■  A2- 

exp 

2it2"^ 

exp 

2cr2_ 

^e^P  'm 

cr2  ^ 


and  under  Ho  is  (27r(T2)“^/2  gxp[(— l/2(T2)m2’m].  This 
signal  6[n  —  k]  is  denoted  in  vector  form  using  the  nat¬ 
ural  basis  vector  e^.  Using  these  to  construct  the  ratio  and 
making  the  appropriate  cancelations  results  in  the  statistic 
exp[(A/(T2)e^P“^m].  This  can  be  written  in  terms  of 
X,  which  we  will  use  as  the  UMPI  test 


N-l 

it/2(x)  =  ^  exp 
1=0 


>  lU2- 


Since  A/(j^  is  known,  and  there  are  no  unknowns  under  the  null 
hypothesis,  the  UMPI  test  exists.  Observe  that  for  this  example 
the  GLRT  is  not  UMPI.  This  is  a  case  in  which  the  UMPI  test 
exists  and  it  is  not  given  by  the  GLRT. 


XOO 

-00  exp 


20-2 


h  (t  (el? 


m^Yn]  +  1)  -  2>l7  (E,Lo^  +  A.4^)  I7I 


N- 


Xoo 

-00  exp 


-1  .7/2  ( N^N-2 


(2) 


XOC 

-00  exp 


2^  I  2;2  -  z2A 


,(E. 


+  NA^ 


N-2 
0 


re]-|-l) 


zG  ^dz 


IZo^Np[^Z^]  \z\N-ldz 


(3) 
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(exp 


,  f^N-2 

exp  I  -  (^E„=o 


~  I  A 
T(m)  b 


+ 


z  I  A 
T(m)  b 


j  +  exp  - 


(^N-2 

\  Z^n=0 


T(m) 


z  -  ^ 


+ 


T(m) 


)]) 


z\’^  ^dz 


2/o“exp[-^]|2|^-id2 


Example  3:  Detection  of  a  DC  Level  of  Unknown  Amplitude 
in  Laplacian  Noise  of  Unknown  Variance:  GLRT  is  not  LFMPI, 
and  UMPI  does  not  exist. 

This  detection  problem  can  be  written  as  in  the  first  example, 
except  that  now  the  noise  is  Laplacian.  The  pdfs  under  the  hy¬ 
potheses  for  this  example  are  given  by 


Px(x;  Wo)  =  exp 

Px(x;  Wi)  =  exp 


tv-i 

E  I^MI 


n=0 


N-1 


E 

n=0 


\x[n]  -  A\ 


As  in  the  first  example,  A  can  be  less  than  or  greater  than  zero. 
The  parameter  b  is  greater  than  zero.  This  problem  is  scale  in¬ 
variant  as  in  Example  1. 

To  find  the  GLRT,  we  first  determine  the  MLEs  of  the  un¬ 
known  parameters  under  each  hypothesis.  These  MLEs  can  be 
shown  to  be  A  =  med(x).  So  =  (l/W)  J2n=o  I^NI’  = 

(l/iV)EEo^  ~  iti6d(x)|,  where  med(x)  is  the  median 
of  X.  Substituting  these  into  px(x;Wo)  and  px(x;Wi)  given 
above,  constructing  the  ratio,  and  simplifying  gives  the  GLRT 


-^G3(x)  = 


EnJo  I^NI 


En=o  -  med(x)| 


>  7G3- 


Observe  that  this  test  statistic  is  scale  invariant  as  expected, 
since  Lg3(cx)  =  Lg3(x). 

To  find  the  UMPI  test,  we  use  the  same  maximal  invariant  as 
in  the  first  example,  and  the  pdf  will  be  obtained  using  the  same 
method.  The  pdf  of  mi  under  Wi  denoted  by  is  prni(mi;  Wi) 
is 


ZAr-2 


\m[n]m[N  —  1]  —  A\ 


^71=0 


+  \m[N  -1]-A\)]  \m[N-l]\ 


N-l 


Marginalizing  over  m[N  —  1]  to  obtain  the  pdf  of  m,  we  have 
Pm(ni;Wi) 


{2b) 
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exp 


ZJV-2 


—  EI't™N-^I+|7-^I 


|7|  dj 
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exp 
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—  '^\-ym[n]+A\  +  \-y+A\ 
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+  exp 


kn=0 


/'N-2 


—  J2\'ym[n]-A\  +  \'y-A\ 


Kn=0 


hr-^dj. 


Writing  the  integral  over  the  domain  0  to  cxo  and  expanding  as 
before,  letting  2;  =  l/b(ff2n=o  l™[rr]|  +  1),  and  making  the 
substitutions  and  appropriate  cancelations,  the  ratio  becomes  as 
shown  by  the  equation  at  the  top  of  the  page,  where  T{m)  = 
l™MI  +  1-  Since  the  denominator  is  not  a  function  of 
the  data,  the  ratio  is  increasing  in  the  numerator  alone,  which 
can  be  considered  the  test  statistic.  Note  that  unlike  in  the  inte¬ 
gral  of  (3)  where  we  could  extract  an  increasing  function  of  the 
data,  revealing  the  independence  on  any  unknown  parameters, 
we  cannot  do  so  here. 

Since  the  test  statistic  requires  knowledge  of  |7l/6|,  which 
is  unknown,  it  cannot  be  implemented,  and  hence  the  UMPI 
test  does  not  exist  for  this  example.  This  is  a  case  where 
the  GLRT  is  invariant,  but  is  not  UMPI,  since  the  UMPI  test 
does  not  exist. 
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